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Abstract — Flight measurement is a critical phase in 
development, validation and certification processes of 
technologies destined for future civilian and military 
operational capabilities. This paper focuses on several recent 
NASA-sponsored remote observations that have provided 
unique engineering and scientific insights of reentry vehicle 
flight phenomenology and performance that could not 
necessarily be obtained with more traditional instrumentation 
methods such as onboard discrete surface sensors. The 
missions highlighted include multiple spatially-resolved 
infrared observations of the NASA Space Shuttle Orbiter 
during hypersonic reentry from 2009 to 2011, and emission 
spectroscopy of comparatively small-sized sample return 
capsules returning from exploration missions. Emphasis has 
been placed upon identifying the challenges associated with 
these remote sensing missions with focus on end-to-end aspects 
that include the initial science objective, selection of the 
appropriate imaging platform and instrumentation suite, 
target flight path analysis and acquisition strategy, pre-mission 
simulations to optimize sensor configuration, logistics and 
communications during the actual observation. Explored are 
collaborative opportunities and technology investments 
required to develop a next-generation quantitative imaging 
system (i.e., an intelligent sensor and platform) with greater 
capability, which could more affordably support cross cutting 


civilian and military flight test needs. 
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1. Introduction 


The design of high-speed aircraft, spacecraft and weapons 
systems is highly dependent on the use of simulation tools 
of varying fidelity. Following early trade studies using low- 
to-mid fidelity systems-level simulation tools, high fidelity 
computational fluid dynamics (CFD) simulations are then 
used to define the aero and aerothermal environment that a 


vehicle will experience during launch, sustained cruise 
and/or atmospheric reentry. Supporting the development 
and validation of these analytical and numerical toolsets are 
test data obtained in ground test facilities, such as 
hypersonic wind tunnels, shock tubes, and arc jets. As 
specialized as these facilities are, they cannot duplicate all 
of the pertinent aerodynamic and aerothermodynamic 
processes-even with multiple facilities and judicious 
experiment designs. Ground-based facility limitations 
coupled with recent systematic advancements in predictive 
capability have led some to forecast a time in the not so 
distant future where flight vehicles will be designed with an 
almost exclusive reliance on numerical methods. However, 
to benchmark, validate and assess the uncertainty of the 
simulation tools, flight- testing [1-3] of the integrated system 
will remain the premiere benchmark for the end-to-end 
vehicle design process. In addition, technologies directed at 
increasing quantitative data capture per flight are essential 
to insuring that the maximum return on investment is 
achieved during these flight tests. 

Measurements obtained in relevant environments during 
actual flight are also crucial to monitor and verify 
operational vehicle health, identify and characterize 
unexpected phenomena and, if necessary, aid in anomaly 
resolution or risk assessment to the general public and 
environment. Historically, flight measurements employ in- 
situ discrete sensors often referred to as Developmental 
Flight Instrumentation (DFI). Naturally, flight 
measurements of this nature come at the expense of added 
internal weight and complexity to the host vehicle and 
subsequent cost/schedule risk to the project. DFI weight 
and cost/risk challenges represent key impediments to 
collecting useful engineering flight data and why, despite 
six trips to Mars, the recent 2012 Mars Science Laboratory 
(MSL) mission represented the first time such a spacecraft 
had been equipped with sensors designed specifically to 
measure the performance of the heatshield during planetary 
entry, descent and landing (EDL). Until MSL, the lack of 
quality flight measurement has essentially bound NASA 
into Viking heritage technology and mass constraints for 
over thirty years [4]. Missed flight measurement 
opportunities have led to a successive line of spacecraft with 
overly conservative (i.e., heavier, costlier) thermal 
protection systems resulting in reduced operational/science 
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capability. 

NASA flight tests of instrumented spacecraft for earth entry 
at velocities at or above those required for lunar return have 
been few and were largely flown prior to the Apollo crewed 
flights - most notably Fire II [5, 6] and Apollo 4 [7, 8]. For 
atmospheric flight tests where vehicle recovery/reuse is not 
a requirement, DFI hardware investments are lost upon 
completion of the mission. When vehicle recovery is 
required, historical precedence suggests any DFI will be 
significantly reduced (or eliminated) when the vehicle is 
transitioned from a developmental to an operational status. 
A prime example is the NASA Space Shuttle program. 
After Space Shuttle Columbia’s five developmental flights 
were completed, the extensive DFI sensor suite [9] was 
removed due to cost and weight penalties. 

The purpose of this paper is to inform the flight test and 
research community of a maturing, quantitative in-flight 
measurement approach based upon remote observation and 
optical instrumentation. While it is acknowledged that in- 
flight measurements derived from imagery will never 
completely replace the intrinsic value of traditional DFI, 
optical-based measurements do offer a complementary or in 
some cases an alternative opportunity to noninvasively 
obtain unique and critical flight data without interfering 
with nominal vehicle operations, weight, performance and 
project scheduling. If properly monitored, optical emissions 
radiating around and from a vehicle during launch or reentry 
because of high temperature gas or high surface temperature 
can provide insights into propulsion system operations, 
aerothermodynamic processes of atmospheric cruise or 
entry and thermal protection system (TPS) performance. To 
illustrate existing remote observation capability to acquire, 
analyze and use of imaging for scientific and engineering 
purposes, the present paper briefly summarizes several 
recent observation campaigns led by the NASA Langley 
(LaRC) and NASA Ames (ARC) Research Centers. These 
observations were- supported by aerial, ground and/or sea- 
based platforms - and they offer a unique opportunity to 
compare and contrast the end-to-end challenges associated 
with the selection of the appropriate imaging platform and 
instrumentation suite selection, knowledge of the spacecraft 
flight path, pre-mission simulation for optimal sensor 
configuration, logistics and communications during the 
actual observation and the data acquisition process. 

The benefits of scientific quality remote observations go 
well beyond simple photoraphic documentation and include 
correlation of critical flight events with on board 
instrumentation and flight anomaly reconstruction. 
Opportunities to develop a next-generation quantitative 
imaging system (i.e., integrated sensor and platform) to 
more affordably support civilian and military flight testing 
are discussed. Such a next generation imaging system could 
either directly or indirectly support developing critical and 
enabling technologies including elements necessary for (but 
not limited to) hypersonic aerothermodynamics, high- 
temperature materials for TPS, flight dynamics and range 


safety including launch, reentry and spacecraft demise 
(orbital debris). This next generation system might evolve 
from the large expensive military or civilian platforms used 
today, towards a smaller, more versatile system such as an 
up looking “intelligent sensor payload” integrated and 
optimized into an unmanned aerial system (UAS), or into a 
high altitude airship. In this long-range vision, sensor and 
platform are integrally connected. Sensor inputs would 
permit completely autonomous operations (i.e., no remote 
pilot). 



Figure 1 - Infrared images of the US Shuttle Orbiter 
during hypersonic reentry taken by NASA HYTHIRM. 
(color pallet varied to enhance detail on each flight) 


2. Thermal imaging (Shuttle Orbiter) 

The NASA Hypersonic Thermodynamic Infrared 
Measurements (HYTHIRM) team utilized aerial and ground 
based infrared (IR) imaging systems to infer surface 
temperature distributions over the viewable windward 
surface of the Shuttle Orbiter during portions of hypersonic 
reentry [10-23]. The in-flight thermal imaging capability, 
discussed herein, represented several years of advocacy 
within the aerothermodynamics technical community [24- 
38] The genesis of the HYTHIRM project and the use of 
optical systems to provide surface temperature was 
motivated by the Shuttle Columbia Accident Investigation 
(CAI) [39-40] and the subsequent Return- to-Flight (RTF) 
effort [41]. Per the recommendation of the CAI board, a 
suite of engineering tools was developed to determine the 
implications of a damaged TPS. A damaged TPS can 
induce local flow disturbances near the surface of the 
vehicle that can produce flow turbulence resulting in 
substantial (and potentially catastrophic) increases in 
surface temperature. Lack of quality flight data to calibrate 
and quantify the uncertainties with a boundary layer 
transition assessment tool resulted in an unprecedented and 
risky spacewalk during STS- 114 to repair observed tile 
damage [42-43]. To lower risk posture for future flights, 
quantitative IR based global temperature measurements with 
adequate spatial resolution and dynamic range were 
proposed to non-intrusively complement the limited 


2 




thermocouple coverage on the Orb iter [44-45]. Over a 
period of approximately the next 2.5 years, seven distinct 
infrared observations of the reentering Orbiter, spanning a 
Mach range from 6.2 to 18.1, were made. Shown in Fig. 1 
are surface temperature contours derived from these 
observations are shown in Fig. 1. 

A majority of these observations were made over the Gulf 



Figure 2 - Near infrared intensity image of 
Endeavour during STS-134 re-entry near the point 
of closest approach, Mach 5.8, Angle-of-Attack = 
28.8 deg, Slant Range ~32 nautical miles 


of Mexico with an aerial-based platform operated by the US 
Navy with an imaging system enhanced by NASA [12]. To 
the best of the author’s knowledge, the 2011 Shuttle Orbiter 
infrared observations near Mach 18 (STS-133) represents 
the highest speed at which calibrated thermal imagery has 
been obtained on a crewed maneuvering vehicle in the 
Earth’s atmosphere that has sufficient spatial resolution to 
delineate local temperatures differences at various locations 
on the vehicle surface. The most recent (and last) thermal 
imagery of an Orbiter during entry was acquired by a 
mobile ground-based optical system located on the west 
coast of Florida during Endeavour’s final flight (STS-134) 
in 2011 [23]. Time lapsed imagery from this ground near 
infrared (NIR) system revealed a phenomenon never before 
observed in flight - the actual development and forward 
progression of flow turbulence at hypersonic speeds on a 
global scale. In Fig. 2, a single still image captures the 
complex thermal footprints (higher temperature shown in 
lighter gray) associated with turbulent flow at the Orbiter 
surface. The time of appearance and the spatial extent of 
flow turbulence is crucial for an optimal TPS design [46- 
47]. This particular image was acquired with the Shuttle 
located near the point of closest approach relative to the 


imaging system yielding a spatial resolution of 
approximately 4-inches per pixel. Distinct thermal 
gradients associated with the individual wing leading edge 
panels are readily observed. The success of the HYTHIRM 
team in acquiring quantitative surface temperature maps of 
the Orbiter windward surface was in large part due to 
development of a suite of mission planning tools [22] that 
facilitated the selection of the proper sensor configuration 
and the optimal location for viewing. The implications of 
proper planning and logistical advantages and disadvantages 
of the various imaging systems will be discussed in 
subsequent sections. 

3. Emission spectroscopy imaging (entry 

VEHICLES) 

The NASA Ames Research Center and the SETI 
Institute have collaborated on the airborne observation of 
several spacecraft reentries. Unlike HYTHIRM ’s focus on 
spatially resolved thermal imaging, the Ames- SETI efforts 
primarily focused on emission spectroscopy of 
comparatively small-sized sample return capsule (SRC) 
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Figure 3 - Measured (yellow) and simulated (solid 
lines) emissions from the Stardust heatshield at an 
altitude of 34.2 miles 

reentry vehicles returning extraterrestrial material from 
exploration missions. SRC’s utilize ablative heat shield 
materials to absorb, transform, and reject high heating 
encountered at reentry velocities from lunar or 
interplanetary travel. These high reentry velocities also 
produce substantial shock layer radiation - and non- 
negligible radiative heating when compared to reentry from 
low earth orbit. Thus, the primary objective of these 
observations was to obtain time-resolved measurements of 
absolute spectral radiance from the reentry capsule and its 
trailing wake. The data were analyzed to reveal quantities 
of importance to atmospheric reentry aerothermodynamics: 
apparent temperatures, shock radiation spectra from high 
temperature gases, ablation species spectra (if present), and 
their temporal evolution during reentry. The first successful 
collaboration was for NASA’s Stardust in 2006 [48-60] 
followed by JAXA’s Hayabusa in 2010 [61,62]. These 
reentry observation campaigns used aerial based imaging 
systems. 
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Because to the small size of the SRC and the distance 
between the SRC and the observing aircraft (typically 100- 
150 nautical miles), the imaging instruments on board the 
aircraft are generally unable to distinguish spatial 
distributions emitted from the SRC surface and surrounding 
gas radiation; the reentering SRC appeared to the 
instruments as a point source of light. Despite being 
spatially unresolved, the thermal (blackbody) emission from 
the heat shield surface was used to infer an apparent 
integrated surface temperature as a function of altitude. An 
example of spectral data recorded from the Stardust SRC 
just after reentry peak heating is compared with predicted 
emissions in Fig. 3. The spectrum in the near ultraviolet 
was acquired with a fiber-coupled slit spectrograph. The 
instrument was designed to capture emission from N2+ and 
CN at high resolution. When correlated to the reconstructed 
trajectory, these altitude-resolved measurements indicate the 
relative variations of shock radiation and ablation processes 
during reentry [48-60]. 



Figure 4 - Fragment spectrum from the Hayabusa 
spacecraft bus reentry disintegration identifying 
emission lines and bands of several chemical species 


In comparison, the JAXA Hayabusa mission’s return to 
Earth in 2010 resulted in a predicted but unintended 
combination of successful SRC capsule reentry and 
destructive reentry of the main spacecraft bus [61]. The 
Hayabusa mission suffered several system malfunctions that 
left the spacecraft without chemical propulsion and with 
only partial use of its ion thrusters. The lack of chemical 
propulsion prevented a planned spacecraft diversion 
maneuver after release of the SRC prior to reentry. Without 
the maneuver, the spacecraft bus followed the SRC into the 
atmosphere along the same trajectory. Although in close 
proximity, the SRC and spacecraft bus were sufficiently 
separated so that the airborne imaging instruments 
simultaneously captured both the SRC reentry and the 
unintended spacecraft bus breakup and disintegration. 
High-resolution spectroscopy instruments were able to 
spatially discriminate individual bus fragments for analysis. 
An example of an uncalibrated spectrum of one bus 
fragment is shown in Fig. 4, where several expected 
chemical species have been identified. These and similar 
data aid in understanding the complex thermal, structural, 


and aerodynamic processes that influence the destructive 
reentry of spacecraft and orbiting launch debris. With the 
eventual demise of the International Space Station (ISS), 
this type of quantitative imagery can improve analysis 
models used to compute debris dispersions that define 
hazard areas which is a key public safety issue. 

4 . Mission planning elements 

While the NASA observation missions described in the 
previous sections had distinctly different imaging objectives 
and were performed and supported by separate 
organizations, they shared many common elements. Overall 
mission planning for these observations hinged on the 
successful integration of several disciplines, namely: 
aerothermodynamics, orbital mechanics, meteorology, 
optics, and systems engineering. In turn, these disciplines 
supported several inter-related elements of mission planning 
and project/technical risk management that include but are 
not limited to: trajectory analysis, asset selection and 
location, aircraft, ground and ship operations, weather 
forecasting, radiance modeling, instrumentation, logistics 
(e.g., airspace, communications, training) and data 
collection. 

Trajectory 

The LaRC and ARC imaging operations teams required 
reliable and timely information regarding their respective 
spacecraft trajectory for mission planning purposes. The 
teams utilized this information to conduct trade studies to 
obtain an optimized acquisition aircraft flight path solution 
that maximized signal quality, minimized risks with target 
acquisition and tracking, accommodated potential trajectory 
dispersions, and complied with other technical and 
geopolitical constraints. The LaRC and ARC imaging 
teams operated on a non-interference basis. That is, neither 
team was permitted to provide inputs to decisions that 
would have officially influenced the reentry flight path of 
the Orbiter or the SRC’s. Trajectory information was 
provided to the LaRC and ARC imaging mission operations 
teams to support decisions on asset placement and tracking 
strategies. The reentry flight path and spacecraft orientation 
relative to the imaging systems were assessed by both teams 
using standard and custom trajectory analysis tools. The 
ARC-SETI team employed the use of TRAJ [63] a 
trajectory analysis tool that provides both the entry path and 
the aeroheating environment which determines the 
appropriate sensor selection. TRAJ provides the SRC 
trajectory using a three-degree-of- freedom simulation with 
appropriate gravitational, atmospheric and aerodynamic 
models. The entry state vector for the SRC vehicles was 
generally pre-determined well in advance of reentry. The 
crippled Hayabusa capsule however, required the NASA Jet 
Propulsion Laboratory (JPL) to provide multiple reentry 
state vector updates based on performance of “corrective” 
bums with the ion thmsters. These updates were critical in 
the re-tailoring of the flight path flown by the imaging 
aircraft. 
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Because of the greater operational flexibility of the Shuttle 
Orb iter, reentry trajectory determination was more complex. 
Compared to the generally pre-determined reentry path of 
the SRC’s, the Orb iter’s reentry path was dependent on the 
earth-relative position of the Orbiter at the time of Space 
Station undock. Factors that affected this position included 
the launch date, duration of the mission and the crew 
timeline. It was not unusual for the Orbiter’ s mission 
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Figure 5 - A myriad of possible Shuttle entry 
trajectories into KSC or EDW returning from the 
International Space Station (ISS). Colors represent 
Mach number during reentry. 

duration to be extended after the vehicle was on-orbit. The 
mission duration set the time for the nominal de-orbit burn 
which then determined the entry state vector. Weather 
permitting, reentry was usually initiated two days after the 
Orbiter undocked from the ISS. During the glide to the 
recovery location at either NASA Kennedy Space Center 
(KSC, primary) or Edwards Air force Base (EDW, 
secondary), the Orbiter performed a series of roll-bank 
maneuvers to manage energy. Reliably predicting the 
orientation of the bottom of the Shuttle relative to the 
imaging asset during these maneuvers is critical. A 
graphical-based simulation tool, Virtual Diagnostics 
Interface (ViDI) [64-67] was used to evaluate the 
anticipated Orbiter ground track and the Orbiter’ s 
orientation. Ground track changes because of on-orbit 
extensions or recovery site diversion from KSC (Florida) to 
EDW (California) are plotted in Fig. 5 using the ViDI tool. 
Given the importance of the trajectory to HYTHIRM 
imagery collection, it was essential to understand how the 
trajectory was derived and how it changed up to and 
including the few minutes just after the Orbiter performed 
its de-orbit bum to initiate reentry. 

Lessons learned — The reentry trajectory was the most 
critical piece of information in planning and executing an 
observation of a reentering spacecraft. The anticipated 
flight path and vehicle orientation ultimately determined the 
physical location of the imaging system and drove 
constraints associated with political borders, air traffic 


control, flight hours, ground travel and mobile telescope 
basing, ship ports of call, and determined likely weather 
patterns to be encountered at the observation sites. In an 
early imaging attempt where no advance planning tools 
were available, supporting aircraft were not provided a 
trajectory update normally issued two hours before landing. 
Consequently, the Orbiter flew almost directly overhead 
precipitating telescope gimbal lock (loss of pointing ability) 
and subsequent loss of signal [33]. 

Asset Selection 

Ultimately, the choice of an optical system is determined by 
the nature of the imaging requirements that in turn, drive the 
asset location. A majority of the high-speed science 
objectives of the NASA observations required deployment 
of the imaging system to locations over water thus 
precluding ground systems. Imaging platform strategies 
tend to favor the flexibility and range of airborne systems. 
The two primary aerial platforms used by the NASA 
imagery teams are shown in Fig. 6. The NASA DC-8 has a 
range of approximately 5,400 miles, an endurance time of 
up to 12 hours and a service ceiling of 41,000 ft. In 
contrast, the Navy P-3 has a range of approximately 4,000 
miles, an endurance time of up to 12 hours and a service 
ceiling of 30,000 ft. The aircraft are used extensively by 
their organizations for earth/atmospheric science and missile 
defense, respectively. These aircraft can generally operate 
above cloud level and the attenuating effects of water and 
aerosols in the atmosphere. Naturally, they can be 
positioned closer to the intended target further mitigating 
detrimental atmospheric effects. Lastly, both multi-engine 
aircraft routinely support over-water operations and are 
more responsive to reasonable changes in the target vehicle 
ground track. Primary weaknesses of the airborne-based 
systems include diffraction limit induced blurring associated 


NASA DC-8 



Navy P-3 



Figure 6 - Aircraft supporting NASA observations. 
(Upper) NASA DC-8-72 Airborne Laboratory based at 
Palmdale, CA. (Lower) Navy “Cast Glance” NP-3D 
Orion based at Pt. Mugu, CA. 
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with small window apertures, image degradation from 
optical bench motions, structural resonance and/or local 
cavity-induced flow turbulence from optical housing. 
Programmatically, the relatively high operational expense of 
a large aircraft generally prohibits support to small flight 
test programs with limited resources. Schedule conflicts 
often develop from other programs competing for the use of 
a shared or “rented” aerial asset. 

For land-based systems, the advantages include lower 
operational expense and large aperture/long focal length 
optics for improved spatial resolution. Commercially 
operated land-based imaging systems do not appear to be as 
susceptible to schedule conflicts. Weaknesses include long 
atmospheric path lengths, increased vulnerability to weather 
(below cloud level and moisture), inability to support large 
deviations in the target vehicle flight path (with a single 
system), and logistical considerations (e.g., system weight, 
availability of access roads, system security and power 
generation). 



Figure 7 - Gyro-stabilized imaging system on Freedom 
Star. Inset: Optical systems within an environmental 
protective dome in proximity to X-band radar used to 
provide pointing instructions during observation 

In addition to the airborne and land-based systems, in 2012 
the NASA LaRC imaging team enabled a new sea-based 
capability [68] on NASA’s Freedom Star, a vessel formerly 
used to recover the Shuttle solid rocket booster hardware. A 
gyro-stabilized tracking mount and long focal length optics 
was successfully mounted onto Freedom Star’s aft deck by a 
commercial entity as shown in Fig. 7. A specialized 
protective dome was required to shield the imaging systems 
against the harsh conditions at sea. NASA’s Commercial 
Orbital Transportation Services (COTS) office desired 
imaging to aid in verification of the Falcon 9 performance 
during key events on ascent, including release of the Dragon 
capsule and solar panel deployments. The latter events 
necessitated the deployment of Freedom Star to the North 
Atlantic, just off the coast of Nova Scotia. 


Lessons learned — Aerial based imaging systems offer many 
distinct advantages. Operating at altitudes above 40,000 ft, 
obscuring cloud coverage is essentially avoided and optical 
absorption from water vapor and scattering from aerosols is 
greatly diminished. Operations conducted at lower altitudes 
(including ground or sea level) were more susceptible to 
weather systems and often compromised science objectives 
or prevented data capture all together. Window constraints 
on aircraft generally set aperture size and limit spatial 
resolution performance (i.e., diffraction limit). Ground 
based systems have demonstrated superior spatial resolution 
performance and some level of mobility but experience has 
shown they are still very susceptible to longer atmospheric 
path lengths, turbulence near the ground and obscuring 
clouds. Sea based imaging systems inherently possess all 
the challenges of a ground system and more. In addition to 
making an observation through a marine layer, pointing 
stability requirements at sea associated with the narrow field 
of view optics represents a significant integration challenge 
in terms of gyro-stabilization and isolation from the ship 
motion and engine vibrations. The LaRC ship based 
observation of the Falcon 9 rocket during ascent was not 
successful due to adverse weather (clouds) that developed at 
the observation site hours just before the launch. 

Weather Forecasting 

Long-range weather forecasting is necessary to evaluate 
asset deployment options. Knowledge of the expected local 
conditions near the time of observation is required to 
mitigate the likelihood of clouds obscuring the desired view. 
The National Weather Service Spaceflight Meteorology 
Group [69] (SMG) located at the NASA Johnson Space 



Figure 8 - STS-134 Shuttle Orbiter reentry ground- 
tracks to KSC superimposed on predicted cloud 
cover forecast. Red corresponds to low relative 
humidity (no cloud cover); Green medium relative 
humidity (some cloud cover); Purple high relative 
humidity (high cloud cover). 


6 






Center provided forecasting support to the LaRC and ARC 
imaging teams. Months in advance of an anticipated 
observation, SMG provided worldwide historical satellite 
cloud and water vapor climatology data and expected sea 
state conditions to assess the viability of potential 
observation locations. Monthly cloud cover data provided 
an outlook of expected impacts on HYTHIRM operations 
throughout the Gulf of Mexico, Central America and the 
Pacific just off the coast of California. SMG also assisted 
the ARC imaging team by providing weather forecasts for 
the region of South Australia where reentry of the Hayabusa 
SRC occurred. Naturally, such statistical cloud coverage 
information was more essential when ground or sea based 
platforms were being considered (or aerial systems with an 
operating ceiling below 25,000 ft). 

For the short term forecasts when mission operations had 
commenced, SMG utilized a customized Advanced Weather 
Interactive Processing System (AWIPS) to superimpose 
Orbiter reentry tracks onto satellite imagery and numerical 
model forecast data (see Fig. 8). These graphics created 
highly effective weather visualization for rapid decision- 
making. When significant cloud coverage was encountered 
at the time of an observation, satellite information was used 
to determine an alternate imaging asset position that would 
present cloud free line of sight (CFLOS) to the target. A 
CFLOS software package developed by Johns Hopkins 
University Applied Physics Laboratory, infers cloud tops 
and bases from real time satellite measurements and 
indicates the level of obstruction by clouds along the line of 
sight from the observer to the target. If an obscured line of 
sight to the target was anticipated, a new observation 
position was identified and relayed to the asset personnel. 

Lessons learned — Access to long-and short-range forecasts 
from professional meteorologists permitted the HYTHIRM 
imaging team to successfully anticipate any possible actions 
on the part of the Flight Director to alter the Orbiter’ s 
reentry path, particularly when weather was the key factor 
in the final de-orbit bum decision (i.e., on-orbit extension or 
diversion to an alternate recovery site). Graphics based 
briefings showing relevant weather conditions relative to the 
anticipated reentry path provided the HYTHIRM team the 
required flexibility to factor in the operational time needed 
to reposition an imaging system if required. 

Instrumen tation 

A detailed discussion of instmment selection and 
configuration is beyond the scope of this overview paper. 
For a more comprehensive description of instmment layout 
for the distinctly different Shuttle Orbiter and SRC 
observations, the reader is referred to Refs. [11, 48, 61]. A 
basic instmment suite consisted of one or more science 
imagers and a target acquisition/tracking camera. The 
acquisition and tracking cameras are typically wide-field-of- 
view (WFOV) low-resolution charge coupled devices 
(CCD’s), carefully bore-sighted to align with science 
imagers. Instmment viewports on the aircraft consisted of 
specialized windows constmcted of optical quality material 
such as fused silica. Clear apertures of up to 16-in in 


diameter were available on the DC- 8 (7-in diameter on the 
P-3). All instmment platform data acquisition systems had 
one or more methods to record time from a universal time 
code generator format (IRIG-B). Time codes were 
necessary to synchronize the imaging data streams with 
critical events occurring during the observation. Positional 
information to determine the distance between the asset and 
the spacecraft were obtained by global positioning satellites. 
Such estimates of optical path length are required to correct 
for atmospheric attenuation. 



Figure 9 - One of several instrument stations in the 
NASA DC-8 that supported an SRC observation 


The SRC observations from the NASA DC-8 employed up 
to 25 individual instmments with overlapping spectral 
ranges and other performance characteristics to mitigate 
against loss of data. Figure 9 illustrates a typical instmment 
setup in the NASA DC-8. Many instmments were slitless 
spectrographs that utilized transmission gratings. Other 
instmments employed fiber-coupled slit spectrographs or 
cameras with band-pass filters to realize spectral resolution. 
For the Hayabusa mission, spectral coverage was from the 
near ultraviolet through the short- wavelength infrared (up to 
1670 nm). Three instmments were devoted to high- 
resolution color video from color-sensitive imaging arrays 
which yielded colored (rather than grayscale) images of the 
dispersed spectra. 

In contrast, the quantitative observations of the Shuttle made 
from the P-3 “Cast Glance” aircraft involved the use of a 
single infrared detector optimized for the anticipated 
thermal measurement. The desired infrared emission range 
from the Orbiter was directed to the detector by a 
miniaturized, gyro-stabilized optical mirror and a long focal 
length lens. Initial evaluations of the Cast Glance legacy 
analog NIR camera indicated poor signal-to-noise ratio and 
insufficient dynamic range to accurately capture the 
expected emitted radiation from the Shuttle Orbiter during 
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descent [12]. Because of this, the legacy analog imager was 
replaced with a digital CCD NIR camera with a spectral 
response of 400 - 1050 nm and a 1360 x 1024 focal plane 
array. A camera with identical specifications was later used 
during subsequent ground based observations. 

Lessons learned — Acquisition of imagery using multiple 
sensors with overlapping capability is recommended to 
mitigate risk due to instrument failure. Also, with a single 
observation port, Cast Glance risk from instrument failure 
was mitigated by the construction of a backup sensor and 
companion acquisition computer. 

Simulation 

Several tools were used to identify and visualize spacecraft 
reentry parameters along with sensor response 
characteristics to make trades for informed decisions. The 
first suite of tools created high-fidelity, orientation- accurate 
synthetic images with the same pixel resolution as the actual 
imaging systems used by the assets. The second suite 
inferred anticipated optical emissions from the spacecraft 
during reentry. Collectively, these results were used 
extensively during pre-mission planning to tailor asset 
position, optimize sensor configuration and avoid over 
exposure (saturation) and loss of data. 


constraints on the viewing angle, spatial resolution and time 
on target. The time accurate position of the Sun was also 
modeled to determine Sun exclusion constraints. 

At the points of interest for the Shuttle Orbiter observations, 
radiance estimates were needed to provide the instrument 
operators pre-flight situational awareness pertaining to 
sensor response characteristics. A Missile Radiance Code 
(MSLRAD) [70] was adapted and used to model the optical 
signature from the Orbiter for any arbitrary orientation and 
in the waveband of interest (see Fig. 10a). MSLRAD 
utilizes material dependent optical properties accounting for 
spectral and angular variation as well as sensor spectral 
response behavior of the vehicle surface material. A 
standard MODTRAN package [71] was used to model the 
electromagnetic radiation propagation through the 
atmosphere and assess transmission losses between the 
imaging asset and the Orbiter. Sensor performance metrics 
were used to generate a 2-D intensity image simulating the 
anticipated detector response. Lastly, the synthetic 
radiometrically accurate image was artificially degraded 
with a point spread function to represent image degradation 
from expected optical and jitter induced motion and detector 
exposure time as shown in Fig. 10b. Pre-flight knowledge 
of this nature was extremely beneficial to the detector 



The ViDI tool developed at LaRC was to initially determine 
the optimum position of imaging asset(s) relative to the 
Shuttle Orbiter [22]. In this graphics based tool, surface 
CAD definition of the vehicle targeted for imaging and six- 
degree-of- freedom trajectory information are imported into 
ViDI to visualize aspects of the entire trajectory on a virtual 
three-dimensional Earth. During a mission, a three- 
dimensional Space Shuttle model was animated along the 
trajectory. The program allows the user to specify an 
imaging asset (e.g., a particular telescope mount on an 
aircraft or a land based system) and quickly determine the 
view/orientation of the Orbiter (or any vehicle) based on the 
asset position at any user specified point during reentry. 
Using this feature, multiple cameras placed at different 
viewing locations were used to assess trade-offs between 


operators who were (in real time) adjusting the integration 
times manually to assure that the raw data would be 
collected in a manner that would span the sensor’s 
maximum dynamic range, while mitigating against 
saturation. 

In comparison, the much smaller SRC’s descent through the 
atmosphere at higher velocities produced optical emission 
from the SRC’s heatshield, the high temperature gases 
surrounding the vehicle, and gases, dust and ablation 
products in the vehicle’s wake. The surface emission is 
thermal in origin and has an assumed graybody spectrum 
with magnitude characterized by the surface’s temperature 
and emissivity. The gas emission originates from the 
excited states of atmospheric air species and other gas-phase 
species originating from heat shield ablation products 
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injected into the vehicle’s boundary layer. The extremely 
high temperatures of the gas between the shock wave and 
vehicle surface drives the population of these excited states. 
Wake radiation originates from species with long-lived 
excited states that have become entrained in the flow behind 
the vehicle. The excited states emit in discrete spectral lines 
and bands characteristic of their atomic or molecular 
structure. High fidelity computational tools [72-74] were 
exercised pre-flight to provide spectral simulations of the 
expected emissions. Atmospheric attenuation was estimated 
with MODTRAN. 

Lessons learned — One of the most significant lessons 
learned from the NASA observations was the importance of 
mission specific planning tools for simulating detector 
response and optimally configuring the instrument 
parameters (i.e., gains, exposure times etc.) for reliable 
acquisition and tracking of the Shuttle Orbiter. Early 
attempts to image the Orbiter were largely unsuccessful [33] 
and were directly tied to the inability to accurately predict 
actual sensor response to the presented infrared signature. 
This initial radiance modeling capability was instrumental in 
underscoring the fact that the legacy analog NIR camera 
used by Cast Glance was inadequate. In early imaging 
attempts where no advance radiance modeling tools were 
available, an aircraft made an attempt to reposition for an 
unscripted high Mach number observation as the Orbiter 
reentered over Texas. Without advance situational 
awareness on the expected optical signature, the instrument 
operators were not successful in distinguishing the Orbiter 
from the horizon background with adequate time to acquire 
and track it, which resulted in complete loss of the remote 
imaging mission. 

Logistics 

Considerable pre-mission planning requiring the skills and 
precise communication between the mission operations 
team, the ground and flight crews, and the instrument 
operators enabled the successful LaRC and ARC 
observations. For the LaRC observations, the mission 
operations team consisting of personnel leading trajectory 
processing, communications and weather were co-located 



Figure 11 - LaRC imaging operations were 

coordinated from the auxiliary Space Shuttle Red 
Flight Control Room (FCR) at NASA JSC 


with a Shuttle Orbiter flight dynamics officer liaison, an 
asset representative, the science team lead and project 
management. Operations were conducted from one of the 
back up mission control rooms as shown in Fig. 11. 

Science objectives of the observations were carefully 
balanced against aircraft or ship transit capabilities and on- 
station loiter times. In turn, asset range and loiter times 
were largely dependent upon projected weather and sea 
states. Long-range programmatic requirements ranged from 
the management of schedule, cost and technical risks to the 
negotiation for diplomatic clearances if flying into foreign 
airspace was anticipated (or military airspace if asset flight 
paths were in proximity to test ranges in the US and 
Australia). In order to facilitate coordination of air traffic 
clearances the LaRC imaging team stationed an experienced 
FAA controller with appropriate language skills in Mexican 
Air Traffic Control (ATC) facilities during mission 
execution. 

A close relationship with the Space Shuttle flight directors 
and flight dynamics officers was essential for monitoring 
conditions of the Orbiter (propellant margins, orbit 
dispersions) and real time events (ISS re-boosts, undock and 
separation burns, orbit adjust burns to optimize de-orbit 
opportunities) that could impact the final Orbiter entry flight 
path. Long range, real-time communication was essential to 
pass last minute trajectory prediction updates and timing 
cues to the asset providers and instrument operators. 
References [22, 61] provide additional insight into the 
logistical planning process. 

Ground-based observations with mobile assets created 
additional operational logistics. In most instances, the 
commercial ground-based asset owner was responsible for 
all ground transportation including transit to the initial 
deployment region and operating the instruments during the 
observation period. Advance coordination with local 
authorities within days of reentry was necessary to ensure 
adequate services (power, security etc.) and to identify the 
availability of unobstructed views. For these reasons, small 
airports were often considered for deployment. During 
STS-131 a ground-based imaging system was transported to 
observation sites often separated by hundreds of miles via a 
NASA UC- 12 aircraft. 

Lessons learned — Dress rehearsals were an important part 
of the training and risk mitigation process. When an aerial 
asset was involved it provided the mission operations team, 
flight crew and instrument operators the opportunity to 
rehearse procedures and become familiar with timing cues 
used during the actual mission. For the Hayabusa mission 
the dress rehearsal flight was conducted at night to allow the 
instrument operators to become familiar with the night sky 
star field in which the spacecraft was to appear. For Shuttle 
Orbiter operations, the aircraft flew into foreign airspace to 
exercise the processes of working foreign airspace requests 
with the appropriate airspace controllers. During the very 
first Orbiter observation with HYTHIRM, an issue with 
access to restricted airspace was quickly resolved because a 
similar scenario was rehearsed in an earlier training 
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exercise. During dress rehearsal, each asset also simulated a 
data capture. For the aircraft, the camera operator worked 
closely with the pilot and aircrew to coordinate maneuvers 
in a pre-determined precision pattern to properly position 
the imaging windows for the data acquisition. Details of the 
flight path planning methodology for the two teams is 
described in detail in Refs. [11, 22]. The ground-based 
systems ran through a full hardware and software set up and 
a communications check with HYTHIRM control. 

Integration of an imaging system to NASA’s Freedom Star 
to support the launch of the inaugural SpaceX launch to the 
International Space Station proved to be a challenge to both 
the instrument operators and the ship’s crew. Since the ship 
had never conducted imaging operations of this nature with 
precise pointing requirements, simple questions pertaining 
to how the optical tracking system would communicate with 
the companion tracking radar had to be addressed. 
Integration and verification of a stabilization system to 
compensate for the rolling and pitching motion of the ship 
proved difficult and time consuming. Design and 
construction of a system to suppress ship motor-induced 
vibrations was more complicated than expected. Enabling 
the large tracking system for viable ship-based operations 
took several months longer than anticipated. It is worth 
noting that while the ship’s crew found sea states very 
benign, the observation team struggled to operate for weeks 
at sea due to physiological issues. 

5 . FUTURE CAPABILITY 
Autonomous Aerial System 

As discussed previously, imaging platform strategies tend to 
favor the flexibility and range of airborne systems, but 
existing crewed systems are inherently cost prohibitive. 
Drones (or high altitude airships) offer one potential path to 
realize the benefits of an airborne imaging platform at a 
more affordable cost. The leadership within the NASA 
Science Mission Directorate (SMD) has recognized that 
unmanned aircraft systems (UAS) have the potential to 
transform the way airborne science platforms contribute to 
earth science related investigations and environmental 
monitoring. The UAS application of the SMD is presently 
focused on enabling the use of autonomous aerial systems 
and advanced remote sensors to conduct earth science and 
atmospheric research. Most recently, a series of NASA 
Global Hawk flights from NASA Wallops Flight Facility 
(WFF) was initiated to begin a five-year mission 
specifically targeted to investigate the processes that 
underlie hurricane formation and intensity change in the 
Atlantic Ocean basin. 

Expanding that innovation to include aeronautical research 
and acquisition of vehicle performance of future aerospace 
systems could enable a paradigm shift towards a reliable, 
flexible, affordable, less invasive process of maximizing the 
return-on-investment of NASA flight testing by 
complementing, enhancing or in limited cases, replacing the 
traditional in-situ DFI measurement approach. 



Figure 12 - Evolutionary autonomous and robotic 
imaging system to support flight test & evaluation 


As conceptually shown in Fig. 12, a truly affordable next 
generation system might evolve from the large expensive 
platforms used today toward a smaller, more versatile 
system; an up looking “smart sensor payload” with a UAS 
(or high altitude airship) optimally designed around it. In 
this long-range vision, sensor and platform are integrally 
connected. Sensor inputs would permit completely 
autonomous operations (i.e., no remote pilot) even in GPS- 
denied environments. Using intelligent flight controls and a 
payload-directed flight, this next generation imagery system 
would ultimately permit autonomous long-range target 
acquisition, tracking, image stabilization and enhancement, 
real-time sensor re-configuration for wave-band selection 
and aircraft attitude/orientation to optimize the data 
collection. Thus, this smart sensor payload would 
significantly increase mission flexibility while reducing 
operational costs. Because UAS are capable of long- 
duration loitering, they are ideal for observations where 
there is uncertainty in mission timelines (i.e., launch or re- 
entry delays). Because they are unmanned, UAS are also 
ideal for conducting operations in remote, dangerous or 
restricted airspace where there is risk to pilot and aircraft. 
As noted earlier, a high altitude capability places sensors 
well above the detrimental effects of the atmosphere. To 
better define UAS operational costs and develop a roadmap 
forward, NASA has initiated a system trade study. With the 
increasing use of unmanned drones for surveillance and 
reconnaissance missions, cooperation with and inputs from 
the sensor and optical community is actively sought to 
improve this trade study. 

On a cost per pixel basis, the development of a small 
versatile robotic imaging system could enable an affordable 
imaging system that is competitive to a traditional DFI type 
temperature data collection architecture. One of the 
challenges with a remote imaging capability is the limited 
time the target vehicle is observed at spatially resolved 
conditions. Traditional in-situ surface or onboard 
measurements can be made continuously during re-entry or 
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sustained flight. Existing capability with a single ground or 
aerial asset only permits observations of tens of seconds at 
meaningful spatial resolution. Multiple autonomous robotic 
imaging platforms positioned along the expected flight path 
could effectively extend observation times. This type of 
strategy would permit extended spatial coverage where 
uncertainties in the flight path are possible or expected, and 
enable distributed capability deployment, where vehicles 
can have varying sensor/manipulator capabilities to better 
achieve a broad range of objectives (i.e., visual, spectral, 
thermal). Such an aerial system would autonomously 
distribute required tasks amongst themselves based upon 
each vehicle’s capabilities/sensor package and adapt to 
changes in the environment, learned knowledge associated 
with the phenomenology of the observation and mitigate 
failures on individual aerial platforms. The time horizon for 
a UAS based imaging system is imminent as there are 
significant ongoing national and international efforts to 
integrate UAS operations into sovereign airspace. It is now 
an opportune time to work UAS payload integration 
challenges. 

6. Summary 

The flight measurement capability demonstrated by the 
NASA LaRC and ARC imagery teams has culminated in a 
high spatial and spectral resolution observations from 
ground, sea and aerial based imaging systems. These 
maturing capabilities suggest several opportunities for 
technical collaboration to advance modeling and 
instrumentation capabilities supporting flight test and 
evaluation and high speed research. The benchmark surface 
temperature maps of the Orbiter lower surface represent a 
rare and unique opportunity for collaborative comparison of 
advanced numerical predictive techniques focused on high 
Mach number laminar flow and hypersonic transition and 
turbulence modeling with in-flight global surface 
temperature maps. The emission data collected during the 
ARC SRC observations provide insight into the 
aerothermodynamic processes of atmospheric reentry and 
the performance of the capsule’s thermal protection system. 

Atmospheric reentry systems for NASA’s future exploration 
missions, such as sample return from Mars, will rely on 
high-fidelity, physics-based design tools validated with 
relevant ground test and flight data. Validation enables 
researchers and engineers to build confidence in the use of 
these design tools, mature their development, and reduce 
risk in future heat shield designs. Collectively, success of 
the LaRC and ARC imaging teams confirm the viability of 
remote observation to support future development initiatives 
for reentry system and hypersonic technologies. 

With targeted investments in optics, infrared sensor and 
imaging platform technologies, remote imaging could 
revolutionize developmental flight measurement technique 
leading to safer, affordable, and environmentally friendly 
access to and from space. Insights from the sensor and 


optics community are encouraged to evolve towards this 
next generation measurement capability. 
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